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Abstract. We study the reach control problem for affine systems on simplices, and the 
focus is on cases when it is known that the problem is not solvable by continuous state 
feedback. We examine from a geometric viewpoint the structural properties of the system 
which make continuous state feedbacks fail. This structure is encoded by so-called reach 
control indices, which are defined and developed in the paper. Based on these indices, we 
propose a subdivision algorithm and associated piecewise affine feedback. The method is 
shown to solve the reach control problem in all remaining cases, assuming it is solvable by 
open-loop controls. 



1. Introduction 

This paper studies the reach control problem (RCP) on simphces. The problem is for 
trajectories of an affine system defined on a simplex to reach a prespecified facet of the 
simplex in finite time. The overall concept of the problem and its setting were introduced 
in [15] and further developed in \16 \ \n \ [26 l [7], The significance of the problem stems from 
its capturing the essential features of reachability problems for control systems: the presence 
of state constraints and the notion of trajectories reaching a goal in a guided and finite-time 
manner. The problem fits within a larger family of reachability problems; namely, to reach 

a target set Xf with state constraint in a set X, denoted as X — > Xf. In the present 
context, we assume that the state constraints give rise to a state space that is triangulable 
[18j : then the reachability specification is converted to a sequence of reachability problems 
on simplices of the triangulation. The reader is referred to [TJ [ISl [IH [171 [261 EH [2] for further 
motivations, including how the studied problem arises in fundamental problems concerning 
hybrid systems 



RCP is one among several different research paths for analysis and synthesis of piecewise 
affine (PWA) feedback [H [Til [27]. Recent progress on explicit MPC schemes has fueled 
the interest in PWA feedbacks [3], such feedbacks play a prominent role in linear switched 
systems |[19j, and PWA systems have significant applications in engineering and biology 
|28 1ll2l[23ll20] . A feature of our approach is that, rather than directly computing a controller 
numerically, we seek conditions for existence of controllers based on the problem data. This 
follows classical lines of thought which are well established in control theory. Another 
classical underpinning is to exploit system structure to understand the limits of a control 
system, again distinguishing our approach from numerical methods. 
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Figure 1. Main idea in a 2D example. 



2. Contributions 



In [7] it was shown that, under a suitable triangulation of the state space, affine feedback 
and continuous state feedback are equivalent from the point of view of solvability of the 
reach control problem (RCP). The approach is based, fundamentally, on fixed point theory. 
The latter allows to deduce that continuous state feedbacks always generate closed-loop 
equilibria inside the simplex when affine feedbacks do. The current paper departs from 
these findings, and using a geometric approach, we explore the system structure that gives 
rise to equilibria. This structure is encoded in so-called reach control indices. The first goal 
of this paper is to elucidate these indices. The second goal is to use the indices to obtain 
a subdivision of the simplex and an associated piecewise affine feedback to solve RCP in 
those cases when the problem is not solvable by continuous state feedback. It is shown that 
RCP is solvable by piecewise affine feedback if it is solvable by open- loop controls. This 
finding gives strong evidence to the relevance of the class of piecewise affine feedbacks in 
solving reachability problems. 

The main ideas of the paper can be understood informally. Consider a 2D simplex S = 
co{uo, ui, ^'2} the convex hull of vertices vq, vi, and V2, with ID facets J-q, J^i, and J^2, as in 
FigurelUa). Consider a single-input control system x = Ax + bu + a defined on S. The reach 
control problem is to find a state feedback u = f{x) such that all closed-loop trajectories 
initialized in S leave S in finite time through the exit facet J-q . The procedure to solve this 
control problem by continuous state feedback is to select control values Ui at the vertices Vi 
such that the velocity vectors Avi + bui + a point inside cone(5), the cone with apex at vq 
determined by S; otherwise trajectories may leave S through J^i or J^2, which is disallowed. 
The controller u = f{x) is formed as a continuous interpolation of the control values at the 
vertices. Label the vertex velocity vectors as yo = + ^"1^0 + O) and bi = Avi + bui + a, 
i = 1,2, as in the figure. Suppose that Ax + a G Im(6) along a line O through vi and V2. 
Clearly closed loop equilibria can only appear on the set Q := SCiO. Now it is obvious that 
this control problem cannot be solved by any continuous state feedback. For at vi , bi has to 
point down to be inside cone(5), but at V2, 62 has to point up. If we continuously interpolate 
along To from vi to V2, the continuous vector field, always in Im(6) along Tq, must pass 
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through zero (by the Intermediate Value Theorem) at some x along J-g. The defect is that 
there are two vertices vi and V2 that "share" the only control direction available, h. 

Suppose we now allow discontinuous feedback. Place a point v' along the edge from to 
t^i and define a new simplex = co{v', vi, ^2}- See Figure [Hb). Notice that as we slide v' 
from vq to vi the cone cone(5^) with apex at v' widens at V2 enough that —62 points inside 
cone(<S^) at V2. Notice also that vi is unaffected by sliding v' . Pick such a v' . Then one can 
construct an affine feedback u = K^x + on <S^ that assigns a non-zero velocity vector at 
every point on Tq^ so there is no closed loop equilibrium in . By [171 ES], RCP is solved 
on . For the remaining simplex S"^ it is also possible to devise an affine controller so 
there is no equilibrium in 5^. This is because equilibria can only appear in at V2 G O. 
But at V2 we can select the velocity vector 62 7^ 0. Again RCP can be solved on S"^ by 
affine feedback. Combining the two affine feedbacks, we get a discontinuous piecewise affine 
feedback that solves RCP on S. Note that a discontinuity is introduced because we use two 
different control values at V2- 

The contribution of the paper is to make mathematically rigorous the informal ideas de- 
scribed above. The main technical difficulty arises in dealing with multi-input systems. For 
this we bring in two tools. First we introduce the reach control indices to group together 
vertices in Q that share control inputs. These indices are similar in spirit to the controllabil- 
ity indices to group together states that share control inputs [10] . As with the controllability 
indices, the reach control indices require a special ordering of a set of linearly independent 
vectors; however, other technical details are different. The second tool is ^-matrices which 
help to concisely represent the constraints on the vector field at vertices of Q. The reader 
is referred to Chapter 6 of [5] for relevant background. 

The paper is organized as follows. In Section [3] we review the reach control problem. In Sec- 
tion |4] we give necessary conditions for solvability by open-loop controls. These then shape 
the assumptions to construct the reach control indices, which are developed in Section O 
In Section [H a subdivision method and associated piecewise afhne feedback are proposed 
to solve RCP when continuous state feedback does not. The main result is presented in 
Section [6] showing the relationship between solvability via open-loop controls and solvabil- 
ity via piecewise affine feeback. Examples are presented in Section [71 Preliminary versions 
of parts of this paper appeared in [8l |9]. Proofs of supporting lemmas are found in the 
Appendix. 

Notation. For x G M", the notation x >- Q {x ^ {)) means > (xj > 0) for 1 < i < n. 
The notation x ^ (x ^ 0) means — x >- (— x ^ 0). Notation denotes the subset of M" 
containing only the zero vector. The notation ^ denotes the open unit ball, and ^ denotes 
its closure. The notation co{vi,V2, ■ ■ •} denotes the convex hull of a set of points Vi G M", 
and sp{yi,y2) • • •} denotes the span of vectors yi € M". The notation {vi,Vj) denotes the 
open segment in M"" between Vi,Vj G Finally, T!s(x) denotes the Bouligand tangent 
cone to set <S at a point x [T3] . 

3. Problem Statement 

Consider an n-dimensional simplex S, the convex hull of n + 1 afhnely independent points 
in M". Let its vertex set be V := {vq, . . . , Vn} and its facets Tq, . . . , Tn- The facet will be 
indexed by the vertex it does not contain. Let hj G M", j = 0, . . . ,n be the unit normal 
vector to each facet J^j pointing outside of the simplex. Facet Tq is called the exit facet of 
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Figure 2. Notation for reach control problem. 



S. Define the index set / := {1, . . . , n}. For x G 5 defined the closed, convex cone 

C{x) := {y \ hj - y <0, j £ I s.t. x G Fj] . 

We'll write cone(5) := C{vq) because C(fo) is the tangent cone to S at vq. We consider the 
affine control system on S: 

x = Ax + Bu + a, (1) 

where A G R"^", a G M", S G W^"^, and rank(B) = m. Let B = Im(B), the image of B. 
Define O := { x G M" \ Ax + a £ B} imd G := S nO. Note that closed-loop equilibria of 
([T]) can only appear in O. Let 4>uit,xo) denote the trajectory of ([I]) starting at xq under 
input u. 

Example 1. Consider Figure\^ where we illustrate the notation in a 2D example. We have 
a full- dimensional simplex in given by S = co{?;o, ^1,^2} with vertex set V = {vo,vi,V2} 
and facets Fq,Fi, and J-2- Each facet Fj has an outward normal vector hj. The only vertex 
not in facet Fj is vertex vj. Fq is the exit facet. If we assume that vq = 0, then subspace 
B is shown passing through vq. The set O is an affine space shown passing through Fq. 
Notice in this case Q = S r\ O = co{fi,f2}. The cone cone(5) is the cone with apex at vq 
determined by S. It is indicated in the figure as the shaded area. The cones C{vi), i = 0,1,2 
are depicted as darker shaded cones attached at each vertex. Of course, the apex of each 
C{vi) is at the origin, but we depict it as being attached at the corresponding vertex Vi since 
it will be used to describe allowable directions for the vector field at the vertices. Notice that 
the cones C{vi) and C{v2) are not tangent cones to S at vi and V2, respectively, whereas 
C{vo) is the tangent cone to S at vq; hence the distinguished labeling ofC{vQ) as cone(5). 

We are interested in formulating a problem to make the closed- loop trajectories of ([T]) exit 
<S through the exit facet Fq only. For this, we require conditions that disallow trajectories 
to exit from any other facet Fi, i £ I. We say the invariance conditions are solvable at 
vertex G F if there exists Ui G such that 

Avi + Bui + a e C{vi) . (2) 

We say the invariance conditions are solvable if ^ is solvable at each Vi G V . The inequal- 
ities ([2]) are called invariance conditions. They guarantee trajectories cannot exit from the 
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Figure 3. The invariance conditions state that yi := Avi + Bui + a € C{vi) 
for i = 0, . . . ,n. 

facets J^i, i G I, and they are used to construct affine feedbacks flGj. For general state feed- 
backs, stronger conditions (also called invariance conditions) are needed. We say a state 
feedback u = f{x) satisfies the invariance conditions if for all x G 5, 

Ax + Bf{x) + aeC{x). (3) 

Example 2. Consider Figure Attached at each vertex is a velocity vector yi := Avi + 
Bui + a, i (z {0} U /. The invariance conditions ^ require that yi G C{vi), as illustrated. 
Notice that velocity vectors at Vi G J^q may or may not point out of S. If the control is an 
affine feedback u = Kx + g such that Ui = Kvi + g, then by convexity of the closed-loop 
vector field, ^ holds at every x & J-i, i G I. If the input is a continuous state feedback 
u = f{x), then invariance conditions for every x (z J-i, i (z I, must be explicitly stated, since 
convexity is not guaranteed; hence ([3]). 

Problem 1 (Reach Control Problem (RCP)). Consider system ^^ defined on S. Find a 
state feedback u = f{x) such that: 

(i) For every x G 5 there exist T > and 7 > such that (j)u{t, x) G 5 for all t G [0, T], 
(j)u(T, x) G To, and (puit, x) ^ S for all t G (T, T + 7). 

(ii) There exists e > such that for every x G <S, \\Ax + Bf{x) + a\\ > e. 

(iii) Feedback u = f{x) satisfies the invariance conditions ([3|). 

Condition (i) is the same condition that appears in the standard formulation of RCP |171l26j. 
It states that all closed-loop trajectories must exit S through J-q in finite time without first 
exiting from another facet. Condition (ii) and (iii) are new, and they are introduced to 
deal with pathologies that can only happen when using discontinuous feedbacks. It can be 
shown that if continuous state feedback is used, then condition (i) implies conditions (ii) 
and (iii) [16]. Therefore, results on affine feedbacks [171 [26] aiid continuous state feedbacks 
[7] remain valid. 

Example 3. In this example we illustrate the need for condition (ii). Figure\^a) illustrates 
a 2D simplex S = co{fo, vi,V2}, where vq = (1, 1), f^i = (0, 0), and V2 = (2, 0). We consider 



6 



MIREILLE E. BROUCKE AND MARCUS GANNESS 



Vq Vq Vq 




Figure 4. Illustration of pathologies that arise using discontinuous feedback 
to solve RCP. 

the linear system on S: 
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Now we select control values uq = 0, ui = 0, and U2 = —3 to satisfy the invariance 
conditions of S, and we solve for the feedback u = — |xi + |x2. The closed loop system has 
an equilibrium in S at vi only, and if we compute the time to reach from any xq G 5 
we find it is finite, despite the presence of the equilibrium. Now we define a discontinuous 
piecewise affine feedback u = f{x) given by f{x) := —\xi + ^X2 for x E S \ {vi} and 
f{vi) := —1. Not only do all trajectories reach J^q in finite time, they also exit S as 
required by condition (i). We have a feasible solution to RCP, but it is not structurally 
stable. If the system parameters {A,B,a) are slightly perturbed and we use u = f{x), then 
there can appear an equilibrium x of the perturbed system in the interior of S, as shown 
in Figure\^b). Thus, RCP is not solved for the perturbed system. Condition (ii) disallows 
such non-robust solutions. 

Example 4. Next consider Figure \^c) which represents a second pathological solution 
to RCP using discontinuous feedback. Here trajectories reach Fq in finite time, and then 
they slide along J-q out of the simplex along a direction at V2 that violates V2 's invariance 
conditions. In order to circumvent this behavior, it is sufficient to disallow feedbacks that 
violate the invariance conditions ([3]), particularly on J-q. This is the purpose of condition 
(Hi). 

In the sequel we will use the shorthand notation S — > J-q to denote that (i)-(iii) of Prob- 
lem [1] hold under some control law. Finally, we make an important assumption concerning 
the placement of O with respect to S. The reader is referred to [7J for the motivation and 
a method of triangulation of the state space that achieves this assumption. See also |18| . 

Assumption 5. Simplex S and system ([T]) satisfy the following condition: if Q 7^ 0, then 
G is a K-dimensional face of S, where < k < n. 

4. Necessary Conditions 

In this section we present two necessary conditions for solvability of RCP using open-loop 
controls. We take as open-loop controls for ([1]) any measurable function /x : [0, 00) — )• 
that is bounded on compact intervals. Now we define what is meant by a solution of RCP 
by open-loop controls. 
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Definition 6. Consider system (OP defined on S. We say S — > J-q by open-loop controls 
if there exists a map T : S and a set of open-loop controls {fj,x | x G 5} such that: 

(i) For every x £ S there exists 7 > such that 4)^^{t,x) € S for all t € [0, T(x)], 
4>fi:,iTix),x) G To, and (j)^^{t,x) ^ S for all t G {T{x),T{x) +7). 

(ii) There exists e > such that for every x G S andt G [0,T(x)], \\A(j)f^^{t,x)+Bfj,x{t) + 
a\\ > e. 

(iii) For every xeS and t e [0,r(x)], {A<j)^^{t,x) + B^i^it) + a) G C(((/>^Jt, x))). 

The first result of the section is that solvability of the invariance conditions ([2]) is necessary 
for solvability of RCP by open-loop controls in the sense of condition (i) only. This extends 
the analogous result in |16j on the necessity of the invariance conditions for solvability of 
RCP (in the sense of condition (i) only) for continuous state feedbacks. Proofs are in the 
Appendix. 

Theorem 7. If S — > J-q by open-loop controls in the sense of condition (i) only, then the 
invariance conditions ([2]) are solvable. 

The second result says that if RCP is solvable by open-loop controls, then it is possible to 
assign non-zero velocity vectors satisfying ([2]) at vertices Vi G V OG- This is an immediate 
consequence of condition (ii). We know that Avi + a ^ B for vertices Vi ^ Q. Theorem [7] 
says that if RCP is solvable by open-loop controls (in the sense of condition (i)), then 
Br\C{vi) 7^ 0, for Vi G V r\Q. The next result says that, moreover, the zero vector cannot 
be the only element of ;B n C(fj), Vi £V HQ. 

Theorem 8. If S — > J-q by open-loop controls, then B n C{vi) ^ 0, Vi £ V HQ. 

5. Reach Control Indices 

The reach control indices are defined in the situation when it is known that RCP is not 
solvable by continuous state feedback but it is still solvable by open-loop controls. According 
to the results of [7|, RCP is not solvable by continuous state feedback under the following 
assumptions. 

Assumption 9. Simplex S and system ([T|) satisfy the following conditions. 

(Al) Q = S n O = co{f 1, . . . , Wk+i}; with < k < n. 
(A2) 0ncone(5) = 0. 

(A3) The maximum number of linearly independent vectors in any set {hi, . . . , | bi G 

B n C{vi)} (with only one vector for each B PI C{vi) ) is fh with < m < k + 1. 
(A4) B n C{vi) / 0, i = 1, . . . , K + 1. 

Assumption (Al) restricts ^ to be a face in Tq. The other cases arising under Assumption[5] 
when Q = % or vq £ Q are trivially solvable (Theorems 6.1 and Remark 7.1 of [7]). If either 
(A2) or (A3) does not hold, then RCP is solved by affine feedback (Theorems 6.2 and 6.7 
of [7j ) . Assumption ( A4) is no loss of generality due to Theorem [51 

Example 10. Consider Figure\^ We have Q = cojwi, 'L'2}, which satisfies (Al). Notice 
(Al) is a strengthening of Assumptions^ - it imposes that vq Q; otherwise RCP is not 
solvable [7]. (A2) is also illustrated in Figure\^ At vq, B has no vectors in common with 
cone(5) except the zero vector. Next, we see that (A3) is satisfied with m = m = 1. In 
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particular, bi £ B D C{vi) and b2 B Ci C{v2) are linearly dependent. Note also that (A3) 
specifies that fh < k + 1. If fh = k + 1, then RCP is solvable by affine feedback [7\. Finally 
(A4) is taken from Theorem\^ It says that at each vertex in Q, there exists a non-zero 
bi & B satisfying the invariance conditions of Vi for i = 1, 2. 

Consider (A3). Select any bi € B H C{vi), i = 1, . . . , k + 1 and write the list {61, . . . , b^+i}- 
Clearly there exists a list with a maximum number in of linearly independent vectors. 
W.l.o.g., we reorder the indices {1, . . . , k + 1} (leaving the indices 0, k + 2, . . . , n the same) 
so that {61, . . . , bfji} are linearly independent. By (A3), m < k + 1 so we can define p > 1 
as 

p := K, + 1 — fh . 

Notice by the maximality of {61, . . . ,bffi}, for each i = fh + 1, . . . , k + 1 and for each 
bi S Br\C{vi), bi G sp{6i, . . . , 6m}. Now consider the cone B {~^ C{vff^j^i). By (A4), 0n 
C{v.ffiJ^i) / 0, so there exists 2 < ri < m + 1 such that w.l.o.g. (reordering indices 1, . . . , fh), 
B{^C{v.ffiJ^i) C sp{6i, . . . , &ri-i} and sp{6i, . . . , ^n-i} is the smallest subspace generated by 
basis vectors among {61, . . . , 6^} only that contains the cone B fl C(um+i). 

Lemma 11. There exists a unique minimal subspace containing ;BnC(vm+i) and generated 
by the basis {bi, . . . ,bfa}. 

In order to have consecutive indices, it is useful to renumber the vertices of Q to effectively 
swap the indices fh + 1 and ri , so we get 

BnC{vr,) Csp{bi,... ,br,-l} . (4) 

The following establishes that one can always find a vector in S R C(uri) that depends on 
all the vectors in {61, . . . , 

Lemma 12 {[8\). Suppose AssumptionlM and ^ hold. There exists b^ G Bf^C{vrl) such 
that 

= Clbl H h Cr-i-l6ri-l , Cj / 0, i = 1, . . . , ri - 1 . (5) 

We now have a list 

{bi, . . . , 6^^, • • • , bfn+i} ■ (6) 

The overbar on bn reminds us that it depends on all the previous ri — 1 vectors in the list. 
For this reason, with br^ := b^, {b2, • • • , ^m+i} are linearly independent. The next result is 
a direct implication of condition (A2). 

Lemma 13. Suppose Assumption{^ and (H|-(l5]) hold. Then the coefficients in ^ satisfy 
Ci < 0, i = 1, . . . ,ri - 1. 

Proof. Suppose w.l.o.g. (by reordering indices {1, . . . ,ri — 1}), there exists 1 < p < ri — 1 
such that Ci > for z = 1, . . . ,p and q < for i = p + 1, . . . , ri — 1. Consider the 
vector /3 := — Cp+i6p+i — ••• — c,.i-i6ri-i = ci6i + ••• + Cpbp. Notice that /3 7^ 
since {bi, . . . ,bp} are linearly independent. Since bi € B nC{vi), i G {1, . . . , ri}, we have 
hj ■ (3 = hj ■ (6^1 - Cp+i&p+i - ■ ■ ■ - Cr-i-i^ri-i) < 0, j = 1, . . . ,p,ri + 1, . . . ,n. Also 
hj ■ j5 = hj ■ (ci6i + • • • + Cp6p) < 0, j = yO + 1, . . . , n. In sum, hj ■ (5 < 0, i G I; that is, 
/3 G S n cone(5). By Assumption (A2), /3 = 0, a contradiction. □ 
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Figure 5. Illustration for Lemma [T5l 



Remark 14. An notable feature of Lemma\lS\ is that any bi, i = 1, . . . ,ri, can be expressed 
as a negative linear combination of the remaining vectors {bi, . . . , . . . ,bri}- This 

means we may renumber indices within {1, . . . ,ri} with impunity, as the formula ([5]) will 
still hold with strictly negative coefficients. Such a renumbering will be invoked in Lemma\24. 
of the next section. 

At this point we have ri cones Br\C{vi), z = 1, . . . , ri, and we have a selection . . . , 6^1 I &i £ 
Bi^C{vi)} with the property that any ri — 1 vectors in the selection is linearly independent, 
and each vector of the selection is a strictly negative linear combination of the others. This 
situation creates strong restrictions on B. Indeed for the vectors . . . , 5^^} to meet these 
properties and to lie in their respective cones, they have a special geometric relationship 
with S, as described next. 

Lemma 15. Suppose Assumption\^ and dl])-® hold. Then 

hj-b^=0, i = l,...,ri, j €/\{l,...,ri}. (7) 

Proof. Let b^ be as in ([5]). Since b^ G BnC{vri), hj ■ br^ = hj ■ (ci6i + • • • + 0^1-16^1-1) < 0, 
j € / \ {1, . . . , ri}. Since bi & B (1 C{vi) and, by Lemma [T3l q < 0, every term in the sum 
is non-negative. The result immediately follows. □ 

Example 16. Lemmas{T^ and{T^ are illustrated for a 3D example in Figure\^ We have 
S = cojuo, . . . , fa}, Q = S <^ O = co{t'i, ^2}, and with t>o = we see that B PI cone(5) = 0. 
Also, m = m = 1. Vector bi shown attached at Vi lies in the cone B n C{vi), i = 1,2. 
Now we observe that 62 = — ci^i, ci > 0, to satisfy bi G BriC{vi). This is the content of 
Lemma [TM. Second, we observe from the figure that the only way bi £ B H C{vi), i = 1,2, 
can hold simultaneously is if h^ ■ bi = 0, i = 1,2. That is, bi and 62 He in the 2D plane 
containing J-3 . This is the content of Lemma \15[ 

Next we consider the cone B H C{vfn+2)- Proceeding as above, there exists a smallest 
subspace generated by the basis {62, . . . ,6^+1} that contains B n C(ff^_|_2). By indepen- 
dently reordering each index set {2, . . . , ri} and {ri + 1, . . . , m + 1} we have B fl C{vffi+2) C 
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sp{6p, . . . , bp^j.2-2}, for some 2 < p < ri + 1 and p<p + r2 — 2<m + l. Lemmas [T2] and [T3l 
can be adapted for B n C{vfft-\-2) since we have exactly the same situation as for B PI C{vri), 
only the indices are changed. Thus, we get 

BnC{vff,^2) ^sp{bp,...,bp+r2-2} (8) 

(36^+2 e SnC(fm+2)) bfh+2 = Cpbp-\ \- Cp+r2-2bp+r2~2 , Ci < . (9) 

We can similarly invoke Lemma [T5] to obtain 

hj ■bi = 0, i = p,...,p + r2-2,m + 2, j e I \ {p, . . . , p + r2 - 2,fh + 2} . (10) 

At this point we know p < ri + 1. Next we show that actually /> = ri + 1. This means 
that the lists {bi, . . . , 6^} and {bp, . . . , bp+r2-2} have no vectors in common. The ensuing 
proof is facilitated by ^-matrices [5j. Let I < a < f3 < k + 1, bi £ B H C{vi), and define 
Ha,[S ■= [ha ■ ■ ■ hjs], Ya^p := [ba - ■ ■ bp], and Ma^p := H'^ ^Ya^p. A matrix M is a ^-matrix 
if the off-diagonal elements are non-positive; i.e. rriij < for all i 7^ j. A matrix M is 
monotone if Mc ^ implies c ^ 0. A ^-matrix M is a nonsingular ^-matrix if it is 
monotone. 

Lemma 17. Suppose AssumptionlM and (j!])-® hold. Also suppose p < ri + 1. Then Mp^^i 
is a nonsingular ^ -matrix. 

Proof. First, we know is a i^-matrix because hj ■ bi < 0, j ^ i, so the off-diagonal 

entries are non-positive. Second, we show Mp^n is monotone, let c = (cp, . . . ,Cri) be such 
that Mp^riC ^ 0. Define y := Yp^^iC Then hj ■ y < 0, j = p, . . . ,ri. Also by Lemma [TSl and 
(fTOD . hj'-y = 0, j = l,...,p-'l,ri + l,...,n. Thus, y € Sncone(5). By (A2), y = 0. 
However, {bp, . . . ,br^} are linearly independent, so c = 0. Thus, Mp^n is monotone. Finally, 
by Theorem 6.2.3 case {N^g) of [5], Mp^n is a nonsingular ^-matrix. □ 

Remark 18. ^ similar result to Lemma [T7| first appeared in [7\; a step of the proof was 
clarified in Here we present a simpler argument based on monotonicity. 

Lemma 19. Suppose Assumptions^ and hold. Then p = ri + 1. 

Proof. Suppose by way of contradiction that p < ri + 1. Applying Lemma [15] we obtain 

hj-bi = 0, i = 1, . . . ,ri , j = ri + l,...,n (11a) 
hj - bi = 0, i = p, . . . , p + r2 - 2,m + 2 , 

j = 1, . . . , p - 1, p + r2 - 1, . . . ,fh + l,m + 3, . . . ,n . (Hb) 

Let a = min{ri,/9 + r2 — 2}. Consider Mp^a- = Hj^^Yp^^r, where Yp^fj = [bp---ba]. By 
Lemma [T71 Mp^n is a nonsingular ^-matrix. By Theorem 6.2.3 and the remarks thereafter 
[5j, Mp^o- is also a nonsingular ^-matrix. By Theorem 6.2.3 (case /28) of [5j there exists 
c' = {dp, . . . ,c'„) such that c' ^ and Mp^^c' -< 0. Define /3 := l^p,o-c' 7^ 0. The statement 
^'p,aP — Mp^a-c' ^ is equivalent to 

hj-l3<0, j = p,...,a. (12) 

By (fniD-ffTlbl). 

hj ■ /3 = hj ■ {cpbp -\ hc'^6^)=0, j = 1, ...,/?- 1, n + 1, n . (13) 

If fj < ri then from (lllbp 

hj-(3 = 0, j = a,...,ri. (14) 
In sum, p^ - (fn|) imply /3 G ;Bncone(5). By Assumption (A2), /3 = 0, a contradiction. □ 
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Lemma [19] tells us that /> + r2 — 1 = ri + r2 so variable p will now be dropped. Now we 
renumber vertices of Q in order to effectively swap the indices ri + r2 and m+2, but we must 
take care that this index swap does not disturb the foregoing construction for . . . ,6ri}- 
In particular, the two index sets {1, . . . , ri} and {ri + 1, . . . , n} in ^ should not become 
entangled with each other. This is the case because ri + r2 > ri + 1, so both ri + r2 and 
m + 2 belong to the index set / \ {1, . . . , ri}. 

Two indices ri and r2 have been put in place. By iterating on Lemmas [T5| [T9| and our 
index swap, we can further decompose B relative to the cones B n C{vi) associated with Q. 
The procedure generates a specially ordered list of the form 

{hi, . . . , hr^^l, ,bri+l, . . . , 6ri+r2-l) ^ri+r2> • • • i ^rl^ hr-p^i+li • • • ) ^r-lj ^r+lj • • • ; &k+i} ) 

(15) 

where bi G B Ci C{vi) and r := ri + ■ ■ ■ + rp. The vectors that do not have an overbar 
are provided by (A3) (modulo the change of indices). The vectors that have overbars are 

provided by Lemma \TI\ and each depends on all of the previous — 1 vectors in 

the list. 

Theorem 20. Suppose Assumption\M holds. There exist integers ri, . . . ,rp > 2 such that 
w.l.o.g. (by reordering indices) 

BnC{Vi) C Sp{5mi, . . . ,6mi+ri-l} , i = TTT-i , . . . , mi + Ti - 1 , (16a) 

Br\C{vi) C Sp{6mp, . . . ,6mp+rp-l} , i = TUp, . . . , TUp + rp - 1 , (16b) 

where bi G BriC{vi), mi := 1, and 

mk:=ri-\ \- rk-i + I , k = 2,...,p. (17) 

Moreover, for each k = 1, . . . ,p, {bm^, . . . , bm^^rk-2} o,re linearly independent and 

bnik+Tk-l = Cmkbrrik^ ^ Cmfc+rfc-2^mfe+rfc-2 , Cj < , i = mfc, . . . , mfc + Tfc - 2 . (18) 

Proof. The vectors 6j G S fl C(vi) in (jl6ap - ()16bp are provided by p^ . including those 
from Lemma [12] (the overbar has now been removed). Lemma [13] gives (llSp . It remains 
only to prove (|16ap - (|16bp . We consider only (|16ap . Consider any i G {l,...,ri} and 
any /3j G PI C{vi) such that /3j = ai6i + ■ ■ ■ + a-r^^r.^ + /3, where aj G M and /3 G i3. 
W.l.o.g. we may assume (3 is independent of {5i, . . . , 6,.-^}. From dJj) and Lemma 1151 
hj ■ I3i = hj ■ (ci^i + • • • + Cr-jftri + /3) = hj ■ 13 < 0, for j = ri + 1, . . . , n. By the proof 
of Proposition 7.2 in fT], /3 = 0. Hence, for any i G {l,...,ri} and (3i G Br\C{vi), 
Pi G sp{6i, . . . , ftri}, as desired. □ 

The integers {ri, . . . ,rp} are called the reac/i control indices of system ([T|) with respect to 
simplex S. 

Remark 21. A number of relationships between the integers k, fh, p, and r are implied by 
the construction. By definition p = K+l — fh. By (A3), fh < k. Then we observe that each 
of the "excess" p vertices ofQ, namely fmi+n-i, t^mp+rp-i; has an associated non-zero 
vector by (A4). By Lemma[T^ each of these p vertices uses up at least one exclusive vector 
in the basis 



{6i, . . . , 6^1-1, ftri+l, • • • , feri+r2-l> • • • ) ^nH hrp-i+lj • • • ; ^r-l} • 
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So we need at least p independent vectors in this basis. That is, 

m>p = K+ l— m. 
Thus, in order for (A4) to hold it is necessary that 



This condition is interpreted to say that RCP is only solvable if there are sufficient inputs. 

The construction does not make any explicit statements about the "extra" linearly indepen- 
dent vectors {6^+1, • • • , ^k+i}- These vectors correspond to cones that were "swapped out" 
due to the index renumbering. Moreover, the cones B H C{vi), z = r + l,...,K + l do not 
enjoy the properties discovered for B r]C{vi), i = 1, . . . ,r. 



The reach control indices catalog the degeneracies (caused by insufficient inputs) that lead 
to the appearance of equilibria in S whenever p > 1 and continuous state feedback is 
applied. Thus, any control method that overcomes the limits of continuous state feedback 
must confront this degeneracy and will necessarily draw upon the degrees of freedom in B 
provided to G which are inscribed by the indices. In this section we investigate the extent 
to which piecewise affine feedback can solve RCP, in cases when continuous state feedback 
cannot. We construct a triangulation [18] of the simplex S such that RCP is solvable for 
each simplex of the triangulation. The next result shows that because of condition (iii) 
of Problem [1] a situation like the one in Figure IHc) cannot happen. Correspondingly one 
recovers a third necessary condition for solvability of RCP by open-loop controls - in essence 
saying that B cannot be parallel to Tq. 

Lemma 22. Suppose Assumption\^and (116aP - (fT8]) hold. If S — > Tq by open-loop controls, 
then sp{6mfe, • • . ,6mfc+rfe-2} (t 'Hq := {y \ hQ ■ y = d} for each k = l,...,p. 

Proof. W.l.o.g. we consider only k = 1. Define := co{vi, . . . ,Vr^} C Fq. Let {/i^} be 
open-loop controls satisfying (i)-(iii) of Definition [6l Let x G 5 and consider any t G [0, T{x)\ 
such that (t, x) ^ Fq. First, by condition (iii) of Definition [H hi ■ {Acp^^ {t, x) + Bfj,x{t) + 

a) < for / G /, (/)^^(t,2;) G Fi. Second, let A(/>^^ (t, x) +i?/Xa;(t) +a = ai6iH hanfen +/3, 

where G M and (3 ^ B. By the same argument as in Theorem [20| /3 = 0. Then by 
Lemma [T5| hj ■ (Acj)^^ (t, x) + Bfix{t) + a) = for j = ri + 1, . . . , n. Suppose by way of contra- 
diction that sp{6i, 6,.^} CHq. Then hQ-{A(j)^^{t,x)+Biix{t)+a) = 0. On the other hand, 
for z G Fo, T^^{z) = {y G M" j /i^ • y = 0, /i, • y < 0,i = 0, n + 1, . . . , n, / G I s.t. z^Fi}. 
We conclude that for all x G 5 and t G [0,T(x)], if (j)^^(t,x) G Fq, then A(j)^^{t,x) + 
BfJ.x{t) + a G T^^(x). Using uniqueness of solutions, we obtain Fq is a positively invariant 
set, a contradiction. □ 

Definition 23. Given system ^ and a state feedback u = f{x), we say f{x) is a piecewise 
affine feedback if there exists a triangulation T ofS such that for each n- dimensional G T, 
there exist G M""''" and g^ G such that f{x) = K^x + , x € . 

This definition of piecewise affine feedback allows for discontinuities at the boundaries of 
simplices; moreover, the feedback is a multi-valued function, distinct from the usual notion 
of piecewise affine function in algebraic topology |22j. Resolving what control value to use 
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at points lying in more than one simplex is treated as a problem of implementation. The 
artifact of a discrete supervisory controller |24j will be introduced to convert the multi- valued 
function to a single-valued feedback. 

We now explain informally an inductive procedure for subdividing S in order that RCP 
can be solved by piecewise affine feedback. First, in Lemma [25] we show that because 
of Lemma [22} each simplex co{vmi,, ■ ■ ■ ^Vm^^r^-i}, k = has a vertex (among 

{vm,,, ■ ■ ■ ,Vmk+ri,-i}) with 5j € B H C{vi) pointing out of S. By convention, we reorder 
indices so this vertex is the first one in each list {vmf, , ■ ■ ■ , ^mk+rk-i}- We make a subdivision 
of S by placing a new vertex v' along the edge {vq, fm^)- In particular, at the first iteration 
we would have v' G (vq, f i), and we form two simplices and S' as in Figure [H Lemma [27] 
shows that because bm,, £8(1 C{vmk) points out of S at and because the invariance 
conditions for S are solvable at vq, a convexity argument (precisely, (I2ip ) gives that v' 
can be placed along (t>o,fmfe) so that B n cone(5^) ^ 0. Then in Lemma [28] one applies 
Theorem 6.2 of [7] to obtain that RCP is solved for S^. Essentially can be removed from 
further consideration, and the induction step is repeated with S replaced by the remainder 
S'. See Figure [7] To guarantee that the induction is sound, one must show that S' inherits 
the relevant properties of S, especially the property of Lemma[22j This is done in Lemma [29l 

Lemma 24. Suppose Assumption \M and (]16aP - (|18p hold. Then w.l.o.g. (by reordering 
indices {mfc, . . . ,mk + rk - 1}), ho ■ bm^ > 0, k = 1,... ,p. 



Proof. We prove the result only for A; = 1. If for any i £ {1, . . . ,ri}, ho ■ bi > 0, then 
the proof is finished. Instead suppose that for all i £ {!,..., ri}, h^ ■ bi < 0. Using 
Lemma [22] and by reordering the indices l,...,ri, assume ho ■ b^^ < 0. By ([H]), bi = 
^ {br^ — C262 — • • • — Cri-i^ri-i) with Cj < 0. Thus we obtain /io-&i = ^O'^ {^n — C2&2 — • • • — Cr-^-ibr-^-i) > 

|/iO • ftri > 0. ' □ 

Example 25. Lemmas\2^ and^2^ are illustrated in Figure\^for a 2D example. We have 
Q = co{vi,V2}, Br\cone{S) = 0, and Br\C{vi) ^ 0, i = 1,2, as required by Assumption\^ 
We observe that B is not parallel to J-q- Otherwise, the only way for trajectories to exit 
J-o would be by violating the invariance conditions at vi or V2 as depicted in Figure^c). 
Therefore, B cannot be parallel to J-q. This is the essence of Lemma \2SX Next, since B 
is not parallel to J-q there is bi £ B r\ C{vi) that points out of S. This is the content of 
Lemma\24\ 

Following Lemma [M] suppose that bi satisfies ho ■ bi > 0. We consider any point v' in the 
open segment {vo,vi). That is, let A £ (0, 1) and define 

v' = Xvi + (1 - \)vo . (19) 

Now define the following simplices in S: 

S' = Co{vo,v',V2,. . . ,Vn} 

= co{i;',t>i,t>2, . . . ,'t;n} • 

Also define the new exit facet for S' hy ■= co{v' , V2, . . . ,Vn}. See Figure [6] The following 
lemma provides a formula for the normal vector h' of J-q. 



14 



MIREILLE E. BROUCKE AND MARCUS GANNESS 




Figure 6. Subdivision into two simplices S' and S^. 



Lemma 26. Let ho = —71/11 — ... — 7„/in with > 0, and let X G (0, 1). Then the normal 
vector to F'q pointing out of 5^ is 

n 

h' = 71 /ii + A ^ jjhj = 71(1 - X)hi - Xho . (20) 
i=2 

Lemma 27. Suppose Assumptionl^ and (jl6ap - (jl8p hold. There exists v' E (fo,fi), such 
that B n cone(5^) ^ 0. Moreover, &i G S n cone(5^) wi^/i h' ■ bi < 0. 

Proo/. Observe that cone{S^) = {y e R'^ \ h' ■ y < ,hj ■ y < 0, j G {2, • • • , n}}. We 
show there is an interval of values for A such that ^ bi £ B (1 cone(5^), where we assume 
the index ordering of Lemma [Ml so that ho ■ bi > 0. First, since 61 G B riC{vi) we know 
hj • 61 < for j G {2, . . . ,n}. We must only show that there exists A G (0, 1) such that 
h' ■ bi < 0. From Lemma [26] we have 

h' ■ bi = - X)hi ■ bi - Xho ■ bi . (21) 

Since /ii • 61 > (because B n cone(5) = 0) and ho • bi > (by Lemma [Ml), it is clear 
from ()2ip that we can select A = A' sufficiently close to 1 such that h' ■ bi < 0. Setting 
v' = X'vi + (1 - X')vo, we get bi e B (1 cone(cS^). □ 

Lemma 28. Suppose Assumptions^ and (|16ap - (|18p hold. Let v' be as in Lemma \2% If the 
invariance conditions for S are solvable, then S — > To by affine feedback. 

Proof. By Lemma [271 we have B n cone(5^) ^ 0. We show that the invariance conditions 
are solvable for S^. First, consider the vertex v' . Since the invariance conditions for S are 
solvable, there exist control inputs uo,ui G M"^ such that the invariance conditions for S at 
t^o and vi are satisfied, i.e. yo ■= Avo+Buo+a G cone(5) and yi := Avi+Bui+a G BnC{vi). 
In particular, hj ■ yi < for 2 = 0,1 and j = 2, . . . , n. Now by Lemma [271 there exists 
A G (0, 1) such that with v' := Xvi + (1 — X)vo, h' ■ bi < and hj • 61 < for j = 2, . . . , n. 
Let wi be such that bi = Bwi. Set ei > and let u' := Xui + (1 — X)uo + eiwi. Then 
y' := Av' + Bu' + a = Ayi + (1 - A)yo + ei^i- Thus, hj ■ y' < ior j = 2, . . . ,n and for ei > 
sufficiently large, h' ■ y' < 0. That is, the invariance conditions for 5^ are solvable at v' . 

Next consider vi. Since the invariance conditions for 5^ at vi are identical to those for 
S at ui, and since the latter are by assumption solvable, the former are also solvable. 
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Figure 7. Notation for the subdivisfon algorithm. 

Finally, consider vertices Vi, i = 2,... ,n. There exist control inputs Ui S M™" such that 
Ui := Avi + Bui + a satisfy /ij • < for j = 2, . . . , z — 1, i + 1, . . . , n. As above let wi be 
such that bi = Bwi. Set ei > and let u[ := Ui + eiWi. Then y'- = Avi + Bu[ + a = yi + €ibi. 
Thus, hj ■ y'- < ior j = 2, . . . ,i — l,i + 1, . . . ,n and for ei > sufficiently large, h' ■ y[ < 0. 
That is, the invariance conditions for 5^ are solvable at Vi. In sum, we can apply Theorem 6.2 

of [7j to obtain that S — > J-q by affine feedback. □ 

Lemma 29. Suppose Assumptionl^ and (|16ap - (|18p hold. Let v' be as in Lemma\2^ If the 
invariance conditions for S are solvable then 

(i) The invariance conditions for S' are solvable. 

(ii) {-h') -^m^ > 0, k = l,...,p. 

Proof. First we prove (i). By assumption the invariance conditions for S are solvable, and 
since the invariance conditions for S' are identical (the only facet that changed for S' is J-q, 
which plays no role in invariance conditions), they are also solvable for S' . Next we prove 
(ii). First we have {—h') ■ bmi > by Lemma [27l Second, since bm^ E B Ci C{vmk), we have 
hi ■ bm^ < 0, for /c = 2, . . . ,p. Also by Lemma [24l ho ■ bm^ > 0, for /c = 2, . . . ,p. Thus using 
i-h') ■ b^^ = -7i(l - \)hi ■ 6^, + Xho ■b^^>0,k = 2,...,p. □ 

We have demonstrated the first step of a triangulation procedure that partitions S into 
simplices on which sub-reach control problems are solvable. Now we present a triangulation 
algorithm that iterates on the presented subdivision method. It consists of p iterations, 
one for each set {vm^., ■ ■ ■ ■,Vm^.+r^.-i}, k = 1, . . . ,p. The notation := co{v',vi, . . . ,Vn} is 
understood to mean that all n + 1 vertices of are assigned simultaneously in the order 
presented. The vertices of S'^ are later identified as {vq, . . . ,v!^}. The algorithm generates 
simplices S^, . . . ,S^~^^ starting from the given simplex S. At the kth iteration, the current 
declaration of S is split into a lower simplex and an upper simplex. The lower simplex 
is then "thrown away" and the remainder - the upper simplex - is declared to be S with 
vertices called {vq, . . . , Vn} (overloading the vertices of the previous S). See Figure [71 In 
this way each iterate mimics the first subdivision developed in the discussion above. 

Subdivision Algorithm: 

1. Set k = l. 

2. Select v' G {vo,Vrn^) such that B fl cone(iS'^) ^ 0, where 5'^ := co{t;', vi, . . . , Vn}- 

3. Set S := co{t)o,-i;i, . . . ,Vmk-l,v' ,Vm,,+l, ■ ■ • ,Wn}- 

4. If k < p, set k := k + 1 and go to step 2. 

5. Set := S. 
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Example 30. Consider the output of the subdivision algorithm for an example with p = 3: 



From this example we observe several features: 

• For each k = 1, . . . ,p, we have Vq £ S'^ n ■ ■ ■ n 5^+^ and v^^^ G 5^ n • • • n 5^^. 

• Simplex 5^"*"^ is the same as the originally given S except that vertices , • • • , 
have been replaced by new vertices Vq, . . . ,Vq, respectively. 

• Because of the previous property GP"*"^ := S^~^^ R O has dropped in dimension to 
K — p = in — 1 because p vertices originally in O have been removed from S^^^. 

Let J-'q = co{vi, . . . ,v^} denote the exit facet of = co{wq, . . . ,v^}. The triangulation 
generated by the algorithm has the property that n S'^^^ = Tq, k = 2, . . . ,p + I, and 

closed-loop trajectories follow paths through simplices with decreasing indices. Thus, S — > 

J-Q is achieved by implementing affine controllers that achieve S — > J-q for k = 1, . . . ,p+l. 
In order to guarantee that switching occurs in the proper sequence (with decreasing simplex 
indices), and to avoid chattering caused by measurement errors, a discrete supermsor should 
accompany the implementation of the piecewise affine feedback. The supervisor enforces 
the following rule: 

(DS) At a point x € S belonging to more than one simplex , the controller for the 
simplex with the higher index is used. 

Theorem 31. Suppose AssumptionlM o,nd (I16ap - (ll8p hold. If the invariance conditions for 
S are solvable, then S J-q by piecewise affine feedback. 

Proof. Form the triangulation {S^ , . . . ,S^^^} of S based on the Subdivision Algorithm. 

We show by induction that S — > J-q by affine feedback for k = 1, . . . ,p (momentarily 

ignoring the rule (DS)). For the initial step, by assumption the invariance conditions for 

S are solvable and by Lemma [231 " > for A; = 1, . . . ,p. Thus, by Lemma [28l 
^1 

S — > J-Q by affine feedback. Now assume that at the jth. step the invariance conditions 
are solvable for (the current) S and ho ■ bm^. > for k = 1, . . . ,p. Then by Lemma [28| 

— > J-Q by affine feedback. Now consider the (j + l)th step. By the algorithm S := 




co{wo, fi, . . . , Vruj-i, v', Vm^+i, ■ ■ ■ , Vn} and ho = —h', where v' and h' are provided by the 
jth step. By Lemma [29l the invariance conditions are solvable for S and ho ■ bm^, > for 

k = 1, . . . ,p. Then by Lemma [28l S^^^ )• J-q^^ by affine feedback. 

Next consider 5^+^. We observe that 5^+^ and S share the same invariance conditions since 
they only differ in their exit facets, so the invariance conditions for 5^+^ are solvable. Now 
let := cSP+^nC Then by the algorithm, 0^+^ = co{f2, • • • , fma-i, ^^ma+i, • • • , Ump-i, t'mp+i 
We can see that the algorithm has removed the p vertices , > • • • i from Q. There 
remain m linearly independent vectors in B associated with Q^^^ (an (m — l)-dimensional 
simplex) given by {62, • • • , tma-i, ^ma+i, • • • , ^m^-i, &mp+i, • • • , ^K+i}- Therefore, we can ap- 
ply Theorem 6.7 of [7] to obtain 5^+^ ^- — y J^q^^ • 



{v^,Vm^,. ..,Vn} where £ (fo,fmi). 

{Vo,vl,Vrm+l, ■■■,Vn} whcrC f§ G (Wc'^ma)- 
{Vo,Vo^Vmi+l, ■ ■ .,VQ,Vm2 + l, ■■■,Vn} whcre G {vo,Vm3)- 
{vo,V^,Vrm + l, ■ ■ . ,V^,Vm2+l,- ■ • , ^^0 , ^^mg+l , • • ■,Vn}- 
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Next, we must prove that trajectories progress through simplices with decreasing indices 
only. Consider w.l.og. the boundary between and given by J'g = co{v',V2, ■ ■ ■ ,Vn}, 
and let u = Kix + gi be the affine feedback obtained for S^. We show that for any xq € 
S^\J-Q, closed-loop trajectories do not reach J^q. This in turn means that trajectories never 
return to S"^ from after leaving 5^. This can be deduced from the proof of Lemma [28] 
where it is shown that the controls {n', n2, . . . , n„} can be selected so that h' -{Av' +Bu' +a) < 
and h' ■ {Avi + Bm + a) < 0, « = 2, . . . , n. By convexity, h' ■ {Ax + B{Kix + 51) + a) < 
for all X G J-q, from which the result easily follows. 

Finally we verify conditions (ii) and (iii) of RCP. Condition (ii) follows immediately because 
there is a finite number of affine feedbacks each defined on a compact set that does not 
contain an equilibrium. For (iii) we must verify that the piecewise affine feedback u = f{x) 
resulting from (DS) satisfies ([3]). We show that it satisfies ([2]), and by convexity also ([3]). 
First consider iS^"^^. Its exit facet is 

-r-p+l r 1 p -1 

~ 1^0' "^mi+l; • • • ) Vmi+n-l^ • • • ; ^0' '^mp+1) • • • ' "^mp+rp-lj Vr+l, . . . , fn/- 

The invariance conditions for 5^+^ are identical to those for S and the controller for 5^+^ 
takes precedence over controllers for simplices with lower index. This implies the invariance 
conditions for S hold at vq and all vertices of J^q^^ ■ The only vertices of J-q that are not in 
Tq'^^ are Vmi,Vm2, ■ ■ ■ ,Vmp- For these vertices we have: G S^, ^ r\S'^,...,Vmp G 
5^ n • • • n 5^. We use the affine controller for the simplex with the highest index. But the 
invariance conditions for at Vmf, are precisely those for S. We can see this because the 
invariance conditions for Vm,. do not include the normal vector —h' given in Lemma [26l □ 

The main result of the paper stated next is that piecewise affine feedbacks are a sufficiently 
rich class to solve RCP when it is solvable by open- loop controls. The proof shows by a 
process of elimination that either RCP is solvable by affine feedback [171 [26| [7] or it is 
solvable by (discontinuous) PWA feedback via the Subdivision Algorithm. 

Theorem 32. Suppose AssumptionlE holds. Then the following are equivalent: 

(1) S J-Q by piecewise affine feedback. 

(2) S — y Tq by open-loop controls. 

Proof. (1) =^ (2) is obvious. 

(2) =^ (1) Suppose S — y J-q by open-loop controls. By Theorem [TJ the invariance 

conditions are solvable. Let Q := S DO. If ^ = 0, then by Theorem 6.1 of [7], 5 — > Tq by 
affine feedback. Suppose instead ^ 7^ 0. If 5 fl cone(5) ^ 0, then by Theorem 6.2 of 0, 

S — > Fq by affine feedback. Suppose instead B PI cone(5) = 0. From Theorem [8l vq 
so by reordering indices, Q = co{ui, . . . ,t>K+i}, where < k < n. Let {fei, . . . ,bffi \ bi € 
BriC{vi)} be a maximal linearly independent set as in (A3). If k < m, then by Theorem 6.7 

of [7], 5 — > Tq by affine feedback. Suppose instead k > fh. By TheoremEl BnC{vi) ^ for 
+ Then Assumption [9] holds and the reach control indices can be defined. 

By Theorem [STj S — > /q by piecewise affine feedback. □ 
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Figure 8. Closed- loop vector fields using (a) affine feedback and (b) piece- 
wise affine feedback. 

7. Examples 



7.1. Example 1. Consider the system 
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1 ■ 




' ■ 




' " 








x + 


1 


u + 






Safety constraints on both xi and X2 determine a polyhedral state space within which the 
dynamics evolve. The polyhedral state space is triangulated according to Assumption [5j 
We focus on the reach control problem for a specific simplex of the triangulation: consider 
the simplex S determined by vertices = (—1,1), vi = (1,0) and V2 = (0,0). It can 
be verified that O = {x ^ 'M? \ X2 = 0}, Q = co{ui,U2}, k = 1, and m = m = 1. 
Also B n cone(5) = 0. By the results of [7], RCP is not solvable by continuous state 
feedback. For example, suppose we choose control values uq = — |, ui = —1, and U2 = 1 to 
satisfy the invariance conditions By the method in [16j . this yields an affine feedback 
= [ — 2 —3.75 ] X + 1. Simulation of the closed-loop system is shown in Figure [8]Ja). 
We observe there exists a closed-loop equilibrium point on Q. Now we show the problem is 
solvable by piecewise affine feedback. 

Let 6i = (0, — 1) G ;B n C{yi). Since /iq = (0, —1), we have ho - hi > 0, verifying Lemma [24l 
Next, we choose v' = (0.5,0.25) along the simplex edge {vq,vi) such that from Lemma [26} 
h' = (-0.25,0.5). Then h' ■ hi < and 6i G S n cow{S^), verifying Lemma EH Let 
5^ := co{?;', i;2}, 5^ := co{fo, f', ^2}) and F'q = co{v',V2}- To satisfy the invariance 
conditions for we choose control inputs at the vertices to be n' = —1, ui = —1, and 
U12 = — 1. Similarly, for 5^ we choose uq = — |, u' = — 1, and U22 = 1- The piecewise affine 
feedback is 

] X - 1 , x G 5^ 

-2.0833 -3.833 ] x + 1 , x G 5^ . 

By Theorem 6.2 of [7J, ^ usmg u. Because Q"^ ■= S"^ r\ O = {V2} , we have rh? = 1 

and = for 5^. By Theorem 6.2 of [7j, 5^ ^ T'q using u. The closed-loop vector field 
is shown in Figure [8)||b), where it is clear that RCP is solved. 



REACH CONTROL ON SIMPLICES BY PIECEWISE AFFINE FEEDBACK 



19 



7.2. Example 2. Consider the simplex S in defined by the vertices vq = (0,0,0,0), 
vi = (1, 0, 0, 0), V2 = (0, 1,0, 0), V3 = (0, 0, 1, 0), and = (0, 0, 0, 1). Consider the system 
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We compute O = {x E | xi + X2 + ^3 + X4 — 1 = 0}. Thus, G = J^o, and we note that 
K = 3, fh = m = 2, and B D cone (5) = 0. By the results of [7], RCP is not solvable by 
continuous state feedback. Now we show it is solvable by piecewise affine feedback. First we 
examine the structure of B (note that indices are not reordered, as is the convention in our 
proofs). We find by inspect that 61 := (-2,1,0,0) E ^nC(t;i), 63 := (0,0,-2,1) e BnC{v3), 
and B = sp{6i, 63}. In particular, 62 := —bi G B (1 C{v2) and 64 := —63 & B (1 C{v4). Thus, 
ri = 2 and r2 = 2. 



7.2.1. First subdivision. In the first iteration S is subdivided into simplices and S'. 
Since 62 • ^0 > 0, we choose v' = (0,0.75,0,0) G {vo,V2) such that we obtain the condition 
,Bncone(5^) / 0. Hence S' = convjwo, vi, v', fs, ^4} and = convju', -yi, ^2, ^3, ^4}. In 
order to satisfy the invariance conditions for the control inputs at the vertices of are 
chosen as u' = (—1, —2), uu = (—1, —2), uu = (— l, —2), U13 = (—1, —2), and uu = (1, 0). 
This yields an affine feedback 
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For S the invariance conditions are solvable and B n cone (5 ) 7^ 0, so by Theorem 6.2 of 

[7], S — > Jo using u. For S' we have G' := S' Ci O = co{vi,V3,V4}. Since k' = 2 and 
m = 2, RCP is not solvable by continuous state feedback on S', and further subdivision of 
<S' is required. 



7.2.2. Second subdivision. Consider the simplex S' = co{t;o) ^'ij 'w', ^^3) ^^4}, where v' G {vq, V2) = 
(0,0.75,0,0) and the exit facet is Tq =conv{z;i, u', ^3, ti4}. We subdivide S' into simplices 
and 5^ and use a piecewise affine feedback law to solve RCP on S' . It is clear that 
64 • /iq > ^-ud therefore we can choose v" G {vq, ^4) such that ;Bncone(4S^) 7^ 0. One choice 
is v" := (0,0,0,0.8). Let = co{vo,vi,v' ,V3,v"} and = co{f", f 1, f', W3, W4}. It can 
be verified that b^ £ B Ci cone(5^). To satisfy the invariance conditions for we choose 
u" = (-4,0.6), U21 = (-5,-1), u' = (-1,-2), U23 = (-5,-1), and U24 = (-3,1). To 
satisfy the invariance conditions for we choose uq = (0,0), U31 = (—1,0), u' = (—1, —2), 
^*33 = (0, —1), and u" = (—4,0.6). This yields a piecewise affine feedback 

' r -1 -1.33 

-2.66 -1 

11 = < 

I 3 9.33 3 5 

-1.33 2 

V 

For 52 the invariance conditions are solvable and B n cone(5^) 7^ 0, so by Theorem 6.2 of 

[7], — > Tq using u. For we have Q3 = S^CiO = co{wi, v^}. Since = I and = 2, 

by Theorem 6.7 of [3, — > T" using u. Indeed, {61,63 | 6j G Br\C{vi)) is a linearly 
independent set associated with Q3. 



-5 
0.75 





-8 " 


X + 


-1 



X G 53 
, X G 52 . 
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8. Conclusion 

The paper studies the reach control problem on simplices, and we investigate cases when 
the problem is not solvable by continuous state feedback. It is shown that the class of 
piecewise afHne feedbacks is sufficient to solve the problem in all cases of interest; namely, 
those cases when the problem is solvable by open-loop controls. 
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9. Appendix 

Proof of Theorem^ Let xq € S\To. By assumption there exists fJ-xoit) and a time T{xq) > 
such that 4>fi^^jit,xo) € S for all t G [0,T(xo)]. Since Uxoit) is an open-loop control, there 
exists c > such that ||/Ua;(,(t)|| < c, for all i G [0,T(xo)]. Define 3^(x) := {^Ax + Bw + a \ w G 
M™} and ydx) := {Ax + Bw + a \ w & M™, \\w\\ < c]. Now take a sequence {U \ U G 
(0, T(xo)]} with ti 0. Since {y G yc{x) | x G 5} is bounded, there exists M > such that 

\\4'iJ.XQ (^ii 2;o) — xqII < Mti. Therefore j '^^^^o ^ y — ^| ^ bounded sequence, and there exists 

a convergence subsequence (with indices relabeled) such that limj_s.oo '^^^o ^ y °^ — - =-, y. 
Since cp^^^^iti^xo) G 5, by the definition of the Bouligand tangent cone, v G Ts{xq). On the 
other hand, we have 



r / ' i^^f^^o ^o) + ^^-0 (^) + a]dT. (22) 

H Jo 



ti i^i Jo 

Taking the limit, we get 

V = Axo + B lim fixoiU) + a G 3^(xo) • 

i—^oo 

We conclude that y{xo) PI r5(xo) 7^ 0, xq G <S \ J^q. Since Ts{vo) = cone(5), and Ts{x) = 
C{vi) for X G {vQ,Vi), it follows that the invariance conditions are solvable at vq and along 
simplex edges {vo,Vi),i G /. 

Now consider Vi,i G /. If Vi G O, then the invariance conditions are solvable by selecting 
Ui G M"^ such that Avi + Bui -|- a = 0. Instead suppose Vi O. Suppose by way of 
contradiction that y{vi)r\C{vi) = 0. Then y{vi) and C{vi) are non-empty disjoint polyhedral 
convex sets in M". By Corollary 19.3.3 of [25j, they are strongly separated. That is, there 
exists e > such that m.iyizy{^y^-)^zeC{iH) \\y~A\ > ^- upper semicontinuity of x 1-^ y{x), 

there exists (5 > such that if ||x — Vi\\ < 6, then y{x) C y{vi) + In particular, taking 
X G {vQ,Vi), we get y{x) r\C{vi) = 0, a contradiction. □ 

Proof of Theorem O Consider Vi G V (iQ. Suppose Br\C{vi) = 0. Since Avi + a G B, there 
exists Ui G M*" such that Avi + Bui -|- a = 0. By (ii)-(iii) of Definition [6l there exists e > 
such that for all x G 5 \ J^o ) there exists Ux G such that Ax + Bux + a £ (x) and 
ll^x -f Bux + a\\ > e. By continuity there exists 5 > such that if ||x — Vi\\ < 5, then 
II Ax -|- Bui + a\\ < e/2. Thus, for x G 5 \ J-q with ||x — Vi\\ < 5, we have ||i?(tix — Ui) \\ > s/2. 
Since B PI C{vi) = and C{vi) is a closed cone, there exists a > such that if 6 G ^ 
satisfies ||6|| > e/2, then {h + a^) r\ C{vi) = %. In particular, we can choose x G {vo,Vi) 
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sufficiently close to Vi such that H^x + Bui + a\\ < min{a, e/2}. Then Ax + Bu^ + a = 
{Ax + Bui + a) + B{ux — Ui) ^ C{vi) = Ts{x), a contradiction. □ 
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